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Amendments to the claims (this listing replaces all prior versions): 

1 . (Currently amended) A computer-implemented method for decomposing images 
in a sequence of images representing a scene, the method comprising: 

transfomiing images in a sequence of images into a log opponent color domain; 

applying a plurality of filters to the transfomied images to generate a plurality of 
sequences of filtered images, the plurality of filters including a derivative filter to be applied to 
produce a derivative in a first direction and a derivative filter to be applied to produce a 
derivative in a second direction, where the first and second directions are different directions; 

calculating a median image for each of the plurality of sequences of filtered images; and 

using the median images to calculate produce a reflectance image for the sequence of 
images, the reflectance image representing an image the application to which the plurality of 
filters would yield substantially the calculated median images for the sequences of filtered 
images, 

2. (Currently amended) The method of claim 1 , fiirther comprising: 
calculating a sequence of illumination images conresponding to the images in the 

sequence of images, s uch that each image in the sequence of images can be represented as [[the]] 
a product of the reflectance image and an illumination image of the sequence of illumination 
images. 

3. (Original) The method of claim 2, further comprising: 

modifying one or more of the reflectance image or the illumination images; and 
combining the reflectance image and the illumination images, including the one or more 
modified images, to create a new sequence of images. 
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4. (Original) The method of claim 2, further comprising: 

modifying one or more of the reflectance image or the illumination images; and 
using the reflectance and illumination.images, including the modified image or images, to 
generate a new image. 

5. (Currently amended) The method of clahn 1 , wherein: 

applying the plurality of filters includes applying each of the plurality of filters to each of 
[[the]] a luminance and chrominance channels of the opponent color space for each pixel in each 
image in the sequence of images. 

6. (Original) The meAod of claim 1 , wherein: 

calculating a reflectance image includes calculating a reflectance image having a 
minimum least squared error between the result of application of each of the plurality of filters to 
the reflectance image and the calculated median image for the corresponding sequence of filtered 
images. 

7. (Original) The method of claim 1, wherein: 

applying a plurality of filters includes applying three or more filters to the transformed 

images. 

8. (Original) The method of claim 7, wherein: 

the plurality of filters includes one or more derivative filters in addition to the derivative 
filter to be applied to produce a derivative in the first direction and the derivative filter to be 
applied to produce a derivative in the second direction, the additional derivative filters being 
applied to produce a derivative in one or more directions other than the first and second 
directions. 
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9. (Original) The method of claim 7, wherein: 

the plurality of filters includes filters operable to produce a derivative at a plurality of 
different firequencies. 

1 0. (Original) The method of claim 1 , fiirther comprising: 
aligning the images prior to transforming the images. 

1 1 . (Original) The method of claim 1, further comprising: 
aHgning the filtered images prior to calculating the median image. 

12. (Currently amended) A computer-implemented method for decomposing images 
in a sequence of images representing a scene, the method comprising: 

transforming images in a sequence of images into a log domain; 

applying a plurality of filters spanning a fi-equencv space to the transformed images in the 
sequence of images , tho plurality of filters including a derivativo filtor to bo applied to produc e a 
d orivativo m a first dirootion, a derivativo filter to bo applied to produoo a derivativo in a second 
defe ction, whore th e first and second directions are differont dir e otions, and ono or more 

calculating a median image for each of the plurality of sequences of filtered images; and 
using the median images to calculat e produce a reflectance image for the sequence of 
images, the reflectance image representing an image the application to which the plurality of 
filters would yield substantially the calculated median images for the sequences of filtered 
images. 

1 3 . (Currently amended) The method of claim 1 2, fiarther comprising: 
calculating a sequence of illumination images corresponding to the images in the 

sequence of images, such that each image in the sequence of images oan bo represented as [[the]] 
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a product of the reflectance image and an illumination image of the sequence of illumination 
images. 

14. (Original) The method of claim 13, fnrther comprising: 

modifying one or more of the reflectance image or the illumination images; and 
combining the reflectance image and the illumination images, including the one or more 
modified images, to create a new sequence of images. 

1 5. (Original) The method of claim 13, further comprising: 

modifying one or more of the reflectance image or the illumination images; and 
using the reflectance and illumination images, including the modified image or images, to 
generate a new image. 

1 6. (Original) The method of claim 1 2, wherein: 

calculating a reflectance image includes calculating a reflectance image having a 
minimum least squared error between the result of application of each of the plurality of filters to 
the reflectance image and the calculated median image for the corresponding sequence of filtered 
images. 

17. (Original) The method of claim 12, wherein: 

the one or more additional filters include one or more derivative filters in addition to the 
derivative filter to be applied to produce a derivative in die first direction and the derivative filter 
to be applied in the second direction, the additional derivative filters being applied to produce a 
derivative in one or more directions other than the first and second directions. 

18. (Original) The method of claim 12, wherein: 

the one or more additional filters include filters operable to produce a derivative at a 
plurality of different fi-equencies. 
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19. (Original) The method of claim 12, further cx)mprising: 
aligning the images prior to transforming the images into the log domain, 

20. (Original) The method of claim 12, further comprising: 
aligning the filtered images prior to calculating the median image. 

2 1 . (Currently amended) A computer program product embodied on an information 
carrier a computer readable medium for decomposing images in a sequence of images 
representing a scene, the computer program product comprising instructions operable to cause a 
computer system to: 

transform images in a sequence of images into a log opponent color domain; 

apply a plurality of filters to the transformed images in the sequence of images, the 
plurality of filters including a derivative filter to be applied to produce a derivative in a first 
direction and a derivative filter to be applied to produce a derivative in a second direction, where 
the first and second directions are different directions; 

calculate a pl urality of median images, orie for each sequence of filtered images; and 

ealoulate produce a reflectance image for the sequence of images, the reflectance image 
representing an image the application to which the plurality of filters would yield substantially 
the calculated median image for the sequence of filtered images. 

22. (Currently amended) The computer program product of claim 2 1 , further 
comprising instructions operable to cause a computer system to: 

calculate a sequence of illumination images corresponding to the images in the sequence 
of images, such that each image in the sequence of images can bo represented as [[the]] a product 
of the reflectance image and an illumination image of the sequence of illumination images. 



23. (Original) The computer program product of claim 22, further comprising 
instructions operable to cause a computer system to: 
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modily one or more of the reflectance image or the illumination images; and 

combine the reflectance image and the illumination images, including the one or more 
modified images, to create a new sequence of images. 

24. (Original) The computer program product of claim 22, further comprising 
instructions operable to cause a computer system to: 

modiiy one or more of the reflectance image or the illumination images; and use the reflectance 
and illumination images, including the modified image or images, to generate 
a new image. 

25. (Currently amended) The computer program product of claim 21, wherein: 
the instructions operable to cause a computer system to apply the plurality of filters 

include instructions operable to cause a computer system to apply each of the plurality of filters 
to each of [[the]] a luminance and chrominance channels of the opponent color space for each 
pixel in each image in the sequence of images. 

26. (Original) The computer program product of claim 21, wherein: 

the instructions operable to cause a computer system to calculate a reflectance image 
include instructions operable to cause a computer system to calculate a reflectance image having 
a minimum least squared error between the result of application of the plurality of filters to the 
reflectance image and the calculated median image for the sequence of images. 

27. (Original) The computer program product of claim 21 , wherein: 

the instructions operable to cause a computer system to apply a plurality of fiUers include 
instructions operable to cause a computer system to apply three or more filters to the images in 
the sequence of images. 
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28. (Original) The computer program product of claim 27, wherein: 

the three or more filters include one or more derivative filters in addition to the derivative 
filters applied to produce a derivative in the first and second directions, the additional derivative 
filters being applied to produce a derivative in one or more directions other than the first and 
second directions. 

29. (Original) The computer program product of claim 27, wherein: 

the three or more filters include one or more filters operable to produce a derivative at a 
plurality of different fi*equencies. 

30. (Original) The computer program product of claim 21 , fiirther comprising 
instructions operable to cause a computer system to: 

align the images prior to transforming the images into the log opponent color domain. 

3 1 . (Original) The computer program product of claim 2 1 , fiirther comprising 
instructions operable to cause a computer system to: 

align the filtered images prior to calculating the median image. 

32. (Currently amended) A computer program product embodied on an information 
©ameF a computer readable medium for decomposing images in a sequence of images 
representing a scene, the computer program product comprising instructions operable to cause a 
computer system to: 

transform images in a sequence of images into a log domain; 

apply a plurality of filters spanning a fi-equencv space to the transformed images in the 
sequence of images , the plurality of filters including a derivative filter to bo applied to produce a 
derivative in a first dir o otion, a derivative filter to b e applied to produce a d e rivative in a s e cond 
direction, whore the first and s e cond directions are different direction s , and one or mor e 
additional filt e rs ; 
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calculate a plurality of median images, one for each sequence of filtered images; and 
oalculQt e produce a reflectance image for the sequence of images, the reflectance image 

representing an image the application to which the plurality of filters would yield substantially 

the calculated median image for the sequence of filtered images. 

33. (Currently amended) The product in claim 32, further comprising instructions 
operable to cause a computer system to: 

calculate a sequence of illumination images corresponding to the images in the sequence 
of images, s uoh that each image in the sequence of images ean b e represented as [[the]] a product 
of the reflectance image and an illumination image of the sequence of illumination images. 

34. (Original) The computer program product of claim 33, further comprising 
instructions operable to cause a computer system to: 

modify one or more of the reflectance image or the illumination images; and 

combine the reflectance image and the illumination images, including the one or more 
modified images, to create a new sequence of images. 

35. (Original) The computer program product of claim 33, further comprising 
instructions operable to cause a computer system to: 

modify one or more of the reflectance image or the illumination images; and 
use the reflectance and illumination images, including the modified image or images, to 
generate a new image. 

36. (Original) ITie product in claim 32, wherein: 

the reflectance image has a minimum least squared error between the result of application of 
each of the plurality of filters to the reflectance image and the calculated median image for the 
corresponding sequence of filtered images. 
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37. (Original) The computer program product of claim 32, wherein: 

the one or more additional filters include one or more derivative filters in addition to the 
derivative filters applied to produce derivatives in the first and second directions, the additional 
derivative filters being applied to produce derivatives in one or more directions other than the 
first and second directions. 

38. (Original) The computer program product of claim 32, wherein: 

the plurality of filters includes one or more filters operable to produce a derivative at a 
plurality of different ft-equencies. 

39. (Original) The computer program product of claim 32, fiirther comprising 
instructions operable to cause a computer system to: 

align the images prior to transforming the images into the log domain. 

40. (Original) The computer program product of claim 32, fiirther comprising 
instructions operable to cause a computer system to: 

align the images prior to calculating the median image. 

41 . (Currently amended) A method for extracting the constant reflectance component 
fi-om a sequence of images of a natural scene comprising: 

capturing a sequence of images of a scene; 

aligning each of the images of the sequence of images; 

transforming each of the images in the sequence of images into a log opponent color 
domain; 

applying a plurality of filters to the images in the sequence of images, the plurality of 
filters including a derivative filter to be applied to produce a derivative in a first direction, a 
derivative filter to be applied to produce a derivative in a second direction, where the first and 
second directions are different directions, and one or more additional filters; 
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calculating a median image for each sequence of filtered images; and 
oaloulating producing a reflectance image for the Original sequence of images, the 
reflectance image having a minimum least squared error between the result of application of each 
of the plurality of filters to the reflectance image and the calculated median image for the 
corresponding sequence of filtered images. 

42. (New) The method of claim 1 2, wherein: 

the plurality of filters spanning a firequency space includes a derivative filter to be 
applied to produce a derivative in a first direction, a derivative filter to be applied to produce a 
derivative in a second direction, where the first and second directions are different directions, 
and one or more additional filters. 

43. (New) The computer program product of claim 2 1 , wherein: 

the plurality of filters spanning a fi-equency space includes a derivative fiher to be applied 
to produce a derivative in a first direction, a derivative filter to be applied to produce a derivative 
in a second direction, where the first and second directions are different directions, and one or 
more additional filters. 



